You don't feel stressed and isolated now??
It's YOUR life, not theirs. Get a good therapist and learn how to stop caring so much about what others think.
Moving away really does help, but you will be taking all of your baggage with you. Start dealing with it now.